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Abstract: The amygdala is known to influence processing of threat-related stimuli in distant brain regions, 
including visual cortex. The time-course of these distant influences is unknown, although this information 
is important for resolving debates over likely pathways mediating an apparent rapidity in emotional proc- 
essing. To address this, we recorded event-related potentials (ERPs) to seen fearful face expressions, in pre- 
operative patients with medial temporal lobe epilepsy who had varying degrees of amygdala pathology, 
plus healthy volunteers. We found that amygdala damage diminished ERPs for fearful versus neutral faces 
within the PI time-range, ~100-150 ms, and for a later component at ~500-600 ms. Individual severity of 
amygdala damage determined the magnitude of both these effects, consistent with a causal amygdala role. 
By contrast, amygdala damage did not affect explicit perception of fearful expressions nor a distinct emo- 
tional ERP effect at 150-250 ms. These results demonstrate two distinct time-points at which the amygdala 
influences fear processing. The data also demonstrate that while not all aspects of expression processing are 
disrupted by amygdala damage, there is a crucial impact on an early PI component. These findings are con- 
sistent with the existence of multiple processing stages or routes for fearful faces that vary in their depend- 
ence on amygdala function. Hum Brain Mapp 31:1089-1105, 2010. © 2009 Wiley-Uss, inc. 
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INTRODUCTION 

The amygdala is considered pivotal to processing emo- 
tional information [Dolan, 2002; Phelps and LeDoux, 2005], 
notably for threat-related stimuli [Amaral, 2002]. Projec- 
tions from the amygdala are hypothesized to orchestrate 
adaptive behavioral and autonomic reactions [Amaral, 
2002; LeDoux, 1996], modulate emotional face processing 
in extrastriate visual cortex [Morris et al., 1998; Noesselt 
et al., 2005; Rotshtein et al., 2001; Vuilleumier et al, 2004], 
and influence encoding of emotional stimuli into long- 
term memory [Dolan, 2002; Richardson et al., 2004; Smith 
et al., 2006]. Amygdala lesions abolish differential BOLD 
responses to fearful stimuli (vs. neutral) in extrastriate 
regions [Vuilleumier et al., 2004]. This latter observation 
accords with a causal role for the amygdala in mediating 
modulatory influences on sensory cortices [Amaral, 2003; 
Armony et al., 1998; LeDoux, 1996; Phelps and LeDoux, 
2005]. However, the sluggish nature of the BOLD response 
means that fMRI data alone cannot reveal the time-course 
of remote amygdala influences. Such information is impor- 
tant to establish whether amygdala emotional responses 
precede or follow other perceptual and face-selective 
responses, such as those within visual cortex (see detailed 
discussion below). 

Evoked related potential (ERP) studies in healthy volun- 
teers have reported effects of threat-related stimuli (e.g. 
seen fearful faces) at several time windows. The earliest 
differential response for fearful versus neutral faces is 
found around ~120 ms poststimulus onset [Eger et al., 
2003; Eimer and Holmes, 2002; Pourtois et al, 2004, 2005a; 
Streit et al., 2003; van Heijnsbergen et al., 2007], corre- 
sponding to the visual PI component that has been argued 
to reflect perceptual processing [Aru and Bachmann, 2009; 
Marzi et al, 2000; Thorpe et al., 1996; though see Brisson 
and Jolicoeur [2008]]. The PI component is hypothesized 
to be generated in posterior occipito-temporal areas [Di 
Russo et al, 2002]. Emotional effects in this time window 
have also been reported for subliminal stimuli [Liddell 
et al., 2004]. The time window of this early scalp ERP 
effect is in line with initial response latencies of the amyg- 
dala shown by intracranial recording in both humans and 
monkeys [Gothard et al., 2007; Krolak-Salmon et al., 2004; 
Oya et al., 2002], though may have a different source. A 
second component, at around ~200 ms for fronto-central 
electrodes, shows differential responses to threat stimuli 
depending on the intensity on the depicted emotion and 
its perception [Ashley et al., 2004; Eimer et al., 2008; 
Holmes et al., 2003; Leppanen et al, 2007; Liddell et al., 
2005; Sprengelmeyer and Jentzsch, 2006]. This subsequent 
ERP effect may last up to 1 s poststimulus presentation 
[Eimer and Holmes, 2007]. Emotional modulations are also 
been reported in the human amygdala within this time 
range [Krolak-Salmon et al., 2004]. Finally, a late effect of 
emotions on ERPs is usually seen over central electrodes 
after ~500 ms [Johansson et al., 2004; Keil et al., 2001; Kiss- 
ler et al., 2006] and is associated with influences of emo- 



tion on episodic memory processes [Liddell et al, 2004; 
Maratos et al., 2000]. It remains entirely unknown whether 
projections from the amygdala contribute to these different 
ERP effects measured at the scalp. Specifically, it is unre- 
solved how early in time amygdala influences on distant 
cortical regions can arise in humans and which (if any) 
threat-related ERP components reflect direct influences 
from the amygdala. 

Two opposing perspectives have been advanced regard- 
ing the possible time-course of amygdala involvement in 
processing threat-related information. The first emphasizes 
that the amygdala receives information following process- 
ing by the corresponding sensory cortices and possibly af- 
ter conscious perception by the observer [Pessoa et al., 
2005a,b]. In accord with this, some neuroimaging studies 
in healthy humans have indicated that some aspects of the 
BOLD response in the amygdala depend on conscious per- 
ception of the stimulus and/or attention [Holmes et al., 
2003; Pessoa et al., 2002, 2005a; Phillips et al, 2004]. 
According to this perspective, one might anticipate that 
amygdala function should influence threat-related ERPs 
relatively late in poststimulus onset, e.g., perhaps after 
~150 ms when the major effects of attention are typically 
observed [Di Russo et al., 2003] and when perception may 
become conscious [Thorpe et al., 1996], including for face 
expressions [Ashley et al., 2004; Eimer et al., 2008; Holmes 
et al, 2003; Leppanen et al, 2007; Liddell et al, 2005; 
Sprengelmeyer and Jentzsch, 2006]. 

An alternative perspective suggests that a rapid 
response, initiated by the amygdala, allows a fast modula- 
tion of sensory processing by the amygdala, especially for 
information containing threat-related signals [Compton, 
2003; Dolan and Vuilleumier, 2003; LeDoux, 1996; Ohman 
et al., 2007; Ohman, 2005; Phelps and LeDoux, 2005; Vuil- 
leumier, 2005]. This perspective receives support from 
neuropsychological studies of "Hindsight" patients with 
lesions to striate and extrastriate cortex, who still retain 
some ability to respond to the presence of threat-related 
stimuli [de Gelder et al., 1999; Pegna et al., 2005] and can 
show preserved amygdala response during fMRI [de 
Gelder et al., 2005; Morris et al, 2001; Pegna et al, 2005]. 
Neuroimaging studies in healthy participants have also 
shown amygdala responses to subliminal threat stimuli 
[Carlsson et al, 2004; Morris et al, 1999] and to stimuli 
outside the main focus of attention [Vuilleumier et al., 
2001]. From this perspective, one might anticipate that 
amygdala influences upon visual ERPs might emerge rela- 
tively early, possibly even for the first ERP effects pro- 
duced by emotion expressions, i.e., for the PI component 
at ~120 ms. However, the actual time-course of amygdala 
contributions to threat-related ERPs has never been 
directly investigated in humans previously. 

A further controversy is whether intact amygdala func- 
tion is necessary for explicit perception of seen emotional 
expressions, particularly fear [Cristinzio et al., 2007; 
Graham et al., 2006; Rapcsak et al., 2000]. Neuropsycholog- 
ical research suggests that impairments in fear recognition 
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may arise only after bilateral lesions to the amygdala 
[Adolphs et al., 1994], but this is not observed in all bilat- 
eral amygdala patients [Adolphs et al., 1999; Graham 
et al., 2006; Hamann and Adolphs, 1999]. Unilateral amyg- 
dala lesions are usually associated with intact explicit fear 
perception [Adolphs et al., 1994], though both unilateral 
right [Meletti et al., 2003] and left amygdala damage have 
been reported to have some impact on fear perception 
[Graham et al., 2006]. It is notable that most patients who 
show clear deficits in explicit perception of fear have 
extensive lesions not confined to the amygdala but impact- 
ing also on adjacent structures [Adolphs and Tranel, 2003; 
Adolphs et al., 2001; Anderson and Phelps, 2000; Ander- 
son et al., 2000; Brierley et al., 2004; Broks et al., 1998]. Fur- 
thermore, several patients who show impairment in 
explicit perception of fearful expressions due to amygdala 
pathology were diagnosed with the rare, genetically deter- 
mined, Urbach-Wiethe syndrome [Adolphs et al., 1994, 
1995; Siebert et al., 2003]. Neuroimaging studies provide 
inconclusive evidence regarding the role of the amygdala 
in explicit recognition of expressions. Some studies suggest 
that amygdala activation to fearful stimuli arises primarily 
during explicit recognition tasks [Krolak-Salmon et al., 
2004], but many others indicate that amygdala responsive- 
ness does not depend entirely on explicit expression recog- 
nition [Bleich-Cohen et al., 2006; Critchley et al., 2000; 
Gothard et al., 2007; Vuilleumier et al, 2001]. 

The aims of our study were to determine the time- 
course of amygdala influences on fearful expression proc- 
essing, by measuring ERPs to fearful versus neutral faces, 
and comparing groups of participants with or without 
amygdala damage. We were also interested in determining 
any impact of such amygdala damage on explicit fear per- 
ception from facial expressions. To address these 
questions, we combined neuropsychological and electro- 
physiological methods. We recorded ERPs to fearful and 
neutral facial expressions from unoperated patients that 
suffer from medial temporal lobe epilepsy (MTLE), with 
varying degrees of amygdala pathology, plus healthy vol- 
unteers. Our analysis focused on differential (fear minus 
neutral) effects of emotional expression on evoked 
responses, from early stimulus onset up to 600 ms. In an 
additional behavioral experiment, we measured explicit 
recognition of fearful expressions in the MTLE patients 
and healthy participants. 

PROCEDURES AND METHODS 

Participants included 17 MTLE patients, of whom 7 (4 
female, 3 left handed, mean age 34.5 years, range 21-A2 
years) had structural pathology that included the amyg- 
dala ("MTLE-amygdala") and 10 others (6 female, 2 left 
handed, mean age 37.7 years, range 23^48 years) with 
damage sparing the amygdala but affecting the hippocam- 
pus and/or other temporal regions ("MTLE-control"). 
None of the MTLE patients experienced any seizure for at 
least 24 h prior to the study. In addition, 13 healthy con- 



trols (7 female, 1 left handed, mean age 31.6 years, range 
20-58 years) were recruited, most of them from among 
friends and relatives of the MTLE patients. None of the 
healthy controls had a clinical history of neurological or 
psychiatric illness. All participants gave written informed 
consent in accordance with local ethics. 

The MTLE patients were recruited from a specialist epi- 
lepsy center and assigned to groups based on clinical diag- 
nosis. This diagnosis was made by a clinician blind to our 
ERP and behavioral hypotheses. Note that all patients 
were diagnosed with unilateral brain pathology. Magnetic 
resonance (MR) T2-weighted images were acquired as part 
of the standard clinical diagnosis, as an indication for scle- 
rosis [Bartlett et al., 2002]. T2 relaxation time above 92 ms 
within the amygdala indicates abnormal tissue [Bartlett 
et al., 2002]. Furthermore, the distribution of T2 signal 
within the healthy population is skewed and hence high 
T2 values, even below 92 ms (the clinical threshold), are 
rare in healthy individuals [Bartlett et al., 2002]. We used 
the structural T2 values as a further regressor in our ERP 
analyses, to perform quantitative tests of any relationship 
between the severity of amygdala pathology and observed 
ERP effects. Six MTLE-amygdala patients were classified 
as showing amygdala sclerosis (five left and one right). 
One MTLE-amygdala patient was diagnosed as having 
damage to the left amygdala based on assessment of the 
amygdala structure in her Tl-weighted MR images. This 
patient did not suffer from sclerosis. 

Importantly, the two patient groups did not differ signif- 
icantly on clinical measures, including duration of epi- 
lepsy, seizure severity, treatment, or general intelligence 
(for details, see Table I), with any nonsignificant trends 
suggesting that, if anything, the MTLE-controls were 
slightly more impaired than the MTLE-amygdala group. 
Note that this tendency could only work against the effects 
we report below. From all the participants who underwent 
the ERP study, 10 healthy, 9 MTLE-control, and 7 MTLE- 
amygdala participants also completed a behavioral test of 
explicit perception for facial expressions (see below). Cru- 
cially, during the data collection, the experimenters were 
blind to the specific group-assignment of the patients. The 
participants were also naive as to the aim of the experi- 
ment, but were debriefed at the end of the experiment. 

Behavioral Study — Explicit Fear Perception 
for Seen Faces 

Expression perception was evaluated using a categoriza- 
tion task of prototypical [Ekman and Friesen, 1976] and 
ambiguous facial expressions from the "morphed-hexa- 
gon" stimulus set [Calder et al., 1996]. The latter stimuli 
were included as they are considered to depict more life- 
like expressions due to their relatively ambivalent nature 
and hence may be more sensitive for detecting any differ- 
ences in explicit expression perception [Adolphs and Tra- 
nel, 2004]. 
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Stimuli 

We used 10 identities, posing six basic prototypical 
expressions (i.e., fear, surprise, happy, angry, disgust, 
and sad), taken from the Ekman and Friesen set [Ekman 
and Friesen, 1976]. Faces were cropped to exclude outline 
features and were presented on a gray background. Of 
these, six identities depicting the prototypical expressions 
were used to assess the perception of prototypical exem- 
plars. Morphed images of the remaining four identities 
were used for the morphed-hexagon set. The morphed 
images were adapted from Calder et al., [1996]. There 
were five levels of morphing in steps of 20%. Pairing of 
expressions was based on a confusion matrix obtained 
from healthy volunteers [Calder et al., 1996]. The morph- 
ing between expressions followed the order: fear-sur- 
prise-happy-anger-disgust-sad-fear. Each identity was 
morphed within itself. A total of 120 morphs were used 
(4 identities x 6 expressions x 5 morph levels). Note that 
ambiguity arises because each morphed face conveys a 
mixture of expressions (see Fig. 1A for examples). 

Procedure 

Each participant categorized the prototypical exem- 
plars first: the six identities posing the six prototypical 
expressions. Each stimulus was presented once in ran- 
dom order with no time limit for a response. The written 
names of the six expressions corresponding to numbers 
(1-6) were presented below the face image. Assignment 
of names to numbers was random across participants. 
Observers were instructed to press the corresponding 
number (on a keyboard) for the expression that best 
described the image, as accurately and quickly as possi- 
ble. No feedback was provided. Testing with the 
morphed-hexagon set followed the same procedure and 
was run subsequently. Each morph was presented twice 
in two separate sessions, with a short break in between 
(total of 240 morphs, 8 for each of the 30 levels). 

Analysis 

Our analysis for the prototypical exemplars scored cor- 
rect and incorrect responses to assess fear recognition. 
We used two approaches to analyze responses to the 
morphed expressions. The first analysis examined 
responses to morphs that included a degree of fear 
expression. A three-way mixed ANOVA was used to 
compute effect of group and morphing parameters on 
the fear responses. In the second analysis, we computed 
the participants' "bias" in perceiving fearful expressions. 
The morphed nature of these stimuli provides ambigu- 
ous expressions, allowing us to determine the tendency 
to read fear in the morphed expressions, rather than 
scoring the responses as correct/incorrect. This "fear 
bias" was estimated by computing the relative number of 
fear responses to all the morphed expressions. We 
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Figure I. 



Explicit perception of emotional expression. (A) Exemplars of 
ambivalent expressions used in the morphed-hexagon expression 
categorization task. Clockwise, starting from the top-left, the 
examples correspond to the midpoint morphs between the fol- 
lowing: fear and surprise; happy and anger; anger and disgust; dis- 
gust and sad; surprise and happy; sad and fear. Note that the 
categorical description of these morphs is unclear and hence influ- 
enced by and revealing of any biases in a particular perceiver. (B) 
"Fear bias" derived for each participant from their explicit judg- 
ments of the morphed stimuli, calculated as the ratio of the total 
number of fear responses to the total number of morphed expres- 
sions shown. All individuals from the healthy (black outline 
circles), MTLE-control (green filled circles), and MTLE-amygdala 

concentrate on this measure rather than on absolute cor- 
rect responses, as previous work indicates that amygdala 
damage usually results in positive judgment biases for the 
character and expressions of unfamiliar individuals 
[Adolphs et al., 1998]. Such a positive bias effect has also 
been observed in monkeys after amygdala damage [Ama- 
ral, 2003]. A one-way ANOVA was used to compare fear 
responses between the groups. 

EEG Study 

Stimuli and experimental procedure 

Photographs of 10 individuals with fearful or neutral 
expressions, taken from the Ekman series [Ekman and 
Friesen, 1976], plus 20 photos of houses were used as stim- 
uli. Houses were cropped to have an elliptical frame, 
while faces were cropped to exclude outline features 



(red solid triangles) groups are plotted, and no differences were 
found between groups. The horizontal lines in the plot depict the 
mean score of the healthy participants ±2 standard deviations. 
(C) The number of "fearful" responses (y-axis) for each morph 
type along the expression-hexagon (x-axis). In the expression-hex- 
agon, morphs are between two expressions; the x-axis presents 
them in following order: surprise-fear, fear-sad, sad-disgust, dis- 
gust-angry, angry-happy, and happy-surprise. Note that for all 
three groups the number of fear responses peaked for the 
morphs: 10% surprise-90% fear and 90% fear- 10% sad. MTLE-cnt 
(control); MTLE-amyg (amygdala); and CI, confidence interval. 
[Color figure can be viewed in the online issue, which is available 
at www.interscience.wiley.com.] 

within a similar frame. Stimuli were presented on a black 
background (Supporting Information Fig. S1A). A factorial 
design with two levels of expression (neutral or fearful) 
and two face orientations (upright or inverted), plus an 
additional condition of upright houses, was employed. 
The stimuli were presented in random order, each for 300 
ms, with an interstimulus interval of 2,200 ms. Partici- 
pants' task was to detect any immediate repetition of a 
stimulus (one-back task), and such repetitions arose with a 
~15% probability regardless of stimulus type. 

The EEG experiment was divided into eight sessions. In 
each session, all stimuli were presented once (60 stimuli + 
~10 target repetitions). To keep the participant motivated 
and alert, they received feedback on their performance at 
the end of each epoch (i.e. accuracy and reaction times for 
detecting occasional immediate repetitions). The experi- 
ment started with a practice session, which was structured 
as an epoch and included presentation of all stimuli. This 
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protocol enabled us to familiarize subjects with the set of 
stimuli used in the experiment and to minimize any nov- 
elty effects for the ERP signal. Observers were instructed 
to maintain fixation throughout the experiment, to avoid 
head movements and blinks, and to respond as quickly 
and accurately as possible. Stimuli were presented using 
Cogentl.24 (www.vislab.ucl.ac.uk/Cogent). Prior to the 
experiment, a photometer was used to measure the exact 
timing of each stimulus onset on the computer monitor, to 
ensure optimal synchronization of the stimulus onsets 
with the EEC trigger recording that was generated by the 
experimental computer. 

EEG recording 

Recordings were made with Ag-AgCl electrodes using 
the NeuroScan system and the 10-20 montage system. 
Twenty-three sites were recorded: Fpz, F7, F3, Fz, F4, F8, 
FC5, FC6, P7, C3, Cz, C4, P8, CP5, CP6, T5, P3, Pz, P4, T6, 
Ol, Or, and Oz, with linked-earlobe reference (see Support- 
ing Information Fig. S2B). Horizontal EOG (HEOG) was 
recorded bipolarly from the outer canthi of both eyes. 
Electrode impedance was kept <5 kQ. Amplifier bandpass 
was O.l^tO Hz. EEG and HEOG were sampled with a digi- 
tization rate of 200 Hz. 

Data analysis 

The ERP analysis was performed using SPM5 (Wellcome 
Trust Centre for Neuroimaging, UCL, London) and Mat- 
lab7.1. The advantage of using SPM5 is that it provides a 
means to correct for familywise errors (FEW) based on the 
random field theory [Penny et al., 2003], while using estab- 
lished statistical methods to test for common and dissoci- 
ated effects. It thus allows a comprehensive analysis 
method not restricted solely to specific electrodes or com- 
ponents of prior interest. Data preprocessing included 
epoching the data from —100 ms prestimulus onset to 
+600 ms poststimulus onset. We defined six event types: 2 
facial expressions x 2 face orientations, houses, and imme- 
diate-repetition (target) trials. ERPs for each event were 
computed relative to the prestimulus baseline (—100 to 0 
ms). An absolute threshold for artifact-removal was set to 
70 |iV to exclude events involving eye blinks, lateral or 
vertical eye movements, and any other artifacts causing 
distortions in the EEG. There were no significant differen- 
ces between the groups in the quality of the EEG signal 
(see Supporting Information Table SI), and none of the 
patients had interictal discharges during the recording. 

Importantly, all follow-up statistical analyses were per- 
formed as interactions of the within-subject and between- 
subject (group) factors. This approach entails that any non- 
specific impact of group per se on the ERP signal, which 
might be due to abnormal brain structures, cannot by itself 
explain the more specific results we describe below. Our 
group comparisons did not assume equal variance. 



SPM-ERP statistical analyses were initially implemented 
on 2D maps generated by a spatial linear interpolation of 
each ERP at each time point [Kiebel and Friston, 2004a,b]. 
We first aimed to replicate the known ERP face effects in 
all three groups, by contrasting faces versus houses at two 
time windows: 100-150 ms, i.e., covering the PI time win- 
dow [Liu et al., 2002], and 150-200 ms, i.e., encompassing 
the N170 [Bentin et al., 1996; George et al, 1996]. The main 
analysis then focused on expression effects between 100 
and 600 ms poststimulus onsets using the following succes- 
sive time windows: 100-150, 150-200, 200-250, 250-300, 
300^00, 400-500, and 500-600 ms. To allow inferences at 
the population level, a second-level random-effects analysis 
was performed, where subjects were treated as random var- 
iables and the independent variable was the averaged dif- 
ferential effect size (the contrast image) for that window. 

At each time window, we first computed an F test of the 
three-way interaction of group-by-facial-expression-by-ori- 
entation across the 2D interpolated images. When this 
interaction was significant, we next performed a separate 
ANOVA for each face orientation condition. Importantly, 
an effect of amygdala pathology on the ERPs was consid- 
ered only if the MTLE-amygdala patients significantly 
(uncorrected P < 0.01 = FWE P < 0.08) differed from both 
the control groups (healthy and MTLE-control), thus 
allowing a replication of the effect, while also controlling 
for epileptic condition. Furthermore, to ascertain a causal 
influence of amygdala pathology on emotional responses 
at specific time windows, we also computed parametric 
statistics where the amygdala pathology was characterized 
quantitatively (based on the separately measured struc- 
tural T2 signal intensity) rather than categorically. The pre- 
diction was that if the amygdala is directly involved in 
modulating ERPs to emotional faces, then more severe 
amygdala pathology would be associated with reduced 
emotional effects on the ERP. 

In addition to test for any effects of facial expressions 
and orientation that were in common for all the three 
groups, we also computed a conjunction analysis (with in- 
termediate null hypothesis [Friston et al, 2005]) for the 
two-way interaction of expression-by-orientation. This 
ensured that the reported common effects were evident in 
each group separately, with a strength that was larger 
than a minimal T value (minT, see "Results"). When sig- 
nificant conjoint interactions were observed, we computed 
separate statistical tests for each face orientation. Effects of 
expressions that were independent of epileptic condition 
or amygdala pathology were considered as common 
effects only if all three groups displayed this effect sepa- 
rately (at uncorrected P < 0.05). 

To further verify our critical results, we also performed 
a complementary statistical analysis independent of the 
SPM approach (i.e. no longer on the 2D interpolated 
maps). High resolution time-bin analysis (5 ms) was per- 
formed to give a more fine-grained temporal characteriza- 
tion, at each electrode separately. Two-sample (not 
assuming equal variance) and one-sample t-tests were 
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used to compute the reliability of differential fear versus 
neutral effects between and across groups, respectively, 
for successive time-bins. A threshold of P < 0.05 and a 
temporal extent of 20 ms were used for inferences and 
applied to the resulting statistical "maps" of ERP effects 
across the narrow time-bins. 

RESULTS 

Behavioral Measures 
Explicit fear perception 

There were no significant differences between groups 
for correct explicit recognition of the prototypical fearful 
expressions (all P > 0.5). Proportion of accurate responses 
(mean ± SD) was as follows: healthy = 0.61 ± 0.23; 
MTLE-control = 0.61 ± 0.28; MTLE-amygdala = 0.52 ± 
0.37. Mixed ANOVA was used to analyze participants' 
responses to the morphed stimuli that included some 
degree of fear expressions (see Fig. 1). The design included 
group as a between factor (e.g. healthy, MTLE-control, 
MTLE-amygdala) and two within factors: the expression 
that was morphed with fear (sad, or surprise) and percent- 
age of fear in the morphed expression (i.e. 10, 30, 50, 70, 
or 90%). Neither amygdala damage nor epileptic condition 
affected the responses to the morphed fear expressions (all 
P > 0.1). More detailed behavioral results are reported in 
the Supporting Information Results. 

Likewise, the fear-bias measure from the morphed-hexa- 
gon stimulus set indicated no significant differences 
between the three groups, i.e. healthy, MTLE-amygdala, 
MTLE-control (all P > 0.15). Out of a total of 240 ambigu- 
ous expressions, healthy participants categorized 16.7% ± 
5 (SD) as fearful; for MTLE-control patients, this was 
12.4% ± 6; and for MTLE-amygdala patients, 17.7% ± 5.8; 
see Figure IB for individual performance. 

One back task 

In the one-back task performed during ERP recording 
(see "Procedures and Methods"), patients and healthy par- 
ticipants' responses did not differ (all Ps > 0.1; see Sup- 
porting Information for details and Supporting 
Information Fig. SI). Reaction times (RTs) were not 
affected by any of the experimental conditions, neither 
stimuli type nor group (all Ps > 0.1). There were also no 
differences in accuracy between faces and houses. Overall, 
all groups were more accurate in detecting repetitions of 
upright than inverted faces (Fi,26 = 9.97, P < 0.01) and 
repetition of fearful than neutral faces (Fi,26 = 5.1, P < 
0.05), but these two factors did not interact (P > 0.1). The 
lack of RT differences between conditions and also of any 
main effects or interactions involving the group factor, 
even for accuracy, suggests that the ERP differences 
reported below could not have been confounded by task 
or attentional demands. We note also that our ERP analy- 
ses did not include the repeated trials, and so error-rate 



for those on target repetition trials could not affect the 
results for the nontarget trials' analyses. 

EEG Data 

Category-selective responses, faces versus houses 

We first assessed general visual processing in the three 
participant groups. House stimuli were included as a con- 
trol visual category to probe the processing of neutral non- 
social stimuli via ERPs, as compared with faces. 
Differential evoked responses to faces versus houses did 
not differ between the three groups (Supporting Informa- 
tion Results and Supporting Information Fig. S2). All three 
groups showed the expected N170 effect for faces com- 
pared with houses that peaked at electrode P8 (all Ps < 
0.05), and also the delayed response to inverted faces com- 
pared with upright faces at this time window (all Ps < 
0.05). Furthermore, healthy subjects and MTLE-amygdala 
patients also showed an earlier face versus house effect 
within the usual PI time window (P < 0.05; Supporting 
Information Results and Supporting Information Fig. S2). 
There was no significant interaction of the PI face effect 
with group at this time window (P > 0.1). These ERP 
results indicate that in our experiment neither amygdala 
pathology nor medical condition (i.e. presence of temporal 
lobe epilepsy) affected face-specific processing, as meas- 
ured by face-versus-house or upright-versus-inverted-face 
ERP differences. Instead, significant effects of amygdala 
pathology upon ERPs, as reported below, were specific to 
the comparison of facial expressions. 

Emotion effects: Fearful versus neutral faces in 
the early PI time window 

Most critically, at the time window of 100-150 ms, corre- 
sponding to the PI component, we observed a significant 
three-way interaction of group-by-expression-by-face ori- 
entation, peaking at electrode Oz (Z = 2.32, P = 0.01, see 
Supporting Information Fig. S3 A). Accordingly, we next 
analyzed ERPs for each face orientation separately. There 
were no significant expression and group effects for 
inverted faces (all Ps > 0.1). This indicates that the PI 
expression effects reported below cannot be attributed to 
any low-level feature differences between expressions that 
would be shared between upright and inverted faces (see 
also Eimer and Holmes [2002]). In contrast, for upright 
faces a significant interaction of group-by-expression was 
observed, involving lateral posterior electrodes on both 
sides, with a peak in vicinity to electrode Or (Z = 2.11, 
P = 0.018). This interaction reflected differences in the fear 
effect for MTLE-amygdala patients versus healthy subjects 
(peaking in vicinity to Or, Z = 2.6, P = 0.003; see Fig. 2), 
and importantly also for MTLE-amygdala versus MTLE- 
control patients (peaking in vicinity to P7, Z = 2.37, P = 
0.009; see Fig. 2). 

For the interaction described above, at this early time 
window, both the healthy group and the MTLE-control 
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patients showed a significantly greater positivity for fear- 1.91, P = 0.028, see Fig. 2D); while for the MTLE-control 

ful than neutral faces. This emotional positivity enhance- patients, this effect predominated over the left-side and 

ment was maximal over posterior electrodes, with a peaked at the nearby electrode T7 (Z = 2.34, P = 0.01). 

distributed scalp effect (Fig. 2A,B). For the healthy group, Direct comparison showed that these latter two groups 

such an expression-effect on PI was observed bilaterally at did not differ significantly in the 100-150 ms time 

several posterior electrodes, maximal at Ol and Or (Z = window. 
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By contrast, for the MTLE-amygdala patients, no elec- 
trode showed any reliable increased positivity to fearful 
versus neutral expressions, over the whole scalp, during 
the same time window (all Ps > 0.1). Thus, the increased 
positivity triggered by fearful expression in the 100-150 
ms time window, which was found in both the healthy 
and MTLE-controls participants, was eliminated by pathol- 
ogy in the MTLE-amygdala group. A complementary 
analysis based on successive 5 ms time windows for each 
electrode separately (see Fig. 3A) revealed that a signifi- 
cant differential (fear-related) response between groups 
arose at occipital electrodes (e.g. Oz), starting at 120 ms 
poststimulus onset. 

If the amygdala is indeed critical for modulating the 
early (100-150 ms, PI) visual processing of fearful faces, 
then in addition to the group effect described above, the 
actual severity of amygdala pathology in individuals 
should predict the degree of ERP attenuation of the fear 
effect in this time window. Severity of amygdala pathol- 
ogy was defined here based on the separately measured 
structural T2 relaxation time (see "Procedures and Meth- 
ods"). We tested for any relation of the MR T2 signal with 
the magnitude of PI modulation by emotion expression, 
using the same parametric approach used in a previous 
fMRI study of temporal sclerosis patients [Vuilleumier 
et al., 2004], but now applied to ERP data instead. As pre- 
dicted, we found significant negative correlations of both 
the left and right amygdala T2 signal with the expression 
effect on ERPs (upright fearful minus neutral), which 
peaked in vicinity to electrode P7 (for left amygdala struc- 
tural T2 signal: Z = 2.2, P = 0 014; for right amygdala 
structural T2 signal, Z = 1.54, P = 0.061). There were no 
significant differences between right and left amygdala 



effects (all Ps > 0.2). These correlations demonstrate that 
the worse the amygdala pathology, the greater the attenua- 
tion of the early PI modulation by fearful versus neutral 
expressions in ERPs (Fig. 2E). 

We note that these correlations were observed even for 
the right amygdala that showed only subclinical pathology 
according to MR T2 signal. This PI correlation with the 
right amygdala seemed to be driven to a large extent by 
the single patient that had, radiologically, significant right 
amygdala damage, as removing this patient from the anal- 
ysis reduced the extent of the correlation (r = —0.332, Z = 
1.2, P = 0.13). 

Emotion effects: Fearful versus neutral faces 
in the midlatency Nl and N2 time windows 

In the two time windows that followed, 150-200 and 
200-250 ms, there was no significant three-way interaction 
of group-by-expression-by-orientation (P > 0.1). Instead, 
the conjunction analysis revealed that all three groups 
showed in common an interaction between expression and 
orientation (Supporting Information Fig. S3B). These inter- 
action effects across group overlapped in vicinity to elec- 
trodes FC5, FC6, and P4 (Z > 2.21, minT 6 > 1.22). Testing 
each face orientation separately revealed that none of the 
groups showed a significant expression effects with 
inverted faces (all Ps > 0.1). However, all three groups 
showed an expression effect for upright faces that was pri- 
marily observed over the central frontal electrodes. The 
maximal effects common for the three groups arose in vi- 
cinity to electrode FC5 at 150-200 ms (Z = 2.64, P = 0.004) 
and at 200-250 ms (Z = 2.38, P = 0.009; see Fig. 4), with no 
significant group-by-expression interactions (all P > 0.1). 



Figu 

Amygdala damage effects at 100-150 ms. (A) 2D topographic maps 
of scalp distribution (occipital regions appear at the bottom of each 
scalp map), depicting ERP responses at I 15 ms poststimulus onset. 
The leftmost column shows responses to upright neutral faces and 
the next column the responses to upright fearful faces, for each of 
the three groups. Warmer colors represent positive ERPs. Note 
that healthy (upper row) and MTLE-control patients (middle row) 
show an increased positivity for fearful faces compared with neutral 
faces, most notably in posterior electrodes, while MTLE-amygdala 
patients do not. This becomes even more evident in (B), which 
shows 2D interpolated maps separately for each group, depicting 
the fearful-minus-neutral subtraction for upright faces, averaged 
across 100-150 ms poststimulus onset. Warm colors represent 
more positive ERP responses for fearful than neutral upright faces. 

(C) SPMs thresholded at P < 0.05, representing a significant inter- 
action of expression (fearful minus neutral upright faces) by group. 

(D) Grand-averaged ERP waveform for upright fearful (red) or neu- 
tral (dotted black) faces, at electrode Ol, plotted separately for 
each group. The PI label highlights the early ERP expression effect. 
Note that the two control groups show a more positive P I compo- 
nent for fearful than neutral faces, while in the MTLE-amygdala 



2. 

group (shown in the rightmost graph) this positivity is diminished 
or even tends to be smaller for fearful than neutral faces. (E) Cor- 
relation between the severity of amygdala structural-abnormality 
(as separately measured by T2 imaging) and the size of the expres- 
sion ERP effects (fear minus neutral for upright faces) during the 
1 00-1 50 ms time window. The left panel presents an SPM depicting 
pixels in the interpolated scalp image that show a conjoint signifi- 
cant correlation (P < 0.05) of the left and right structural T2 signal 
from amygdala with the PI expression effect. The plots on the right 
shows the T2 signal of right or left amygdala plotted against the 
expression effect on PI , extracted from the topography peak (in vi- 
cinity to P7 for the left amygdala and P3 for the right amygdala). 
Red circles depict the MTLE-amygdala patients and black circles the 
MTLE-control patients. Note that more severe damage to the 
amygdala is associated with smaller expression effect (fearful — neu- 
tral) in ERPs for the 100-150 ms time window. The correlation of 
the right amygdala seems to be primarily driven by the single patient 
who had a radiologically evident lesion to this structure. MTLE- 
amyg = patient group with amygdala damage; MTLE-cnt = control 
group of temporal-lobe-epilepsy patients, with structurally intact 
amygdala. 
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Time-course of expression effects. Statistical parametric results of 
point-by-point t-tests, with the y-axis corresponding to particular 
electrodes, and the x-axis to particular successive 5 msec time- 
bins post-stimulus. The statistical maps are threshold at P < 0.05 
and depict the detailed time-course for expression effects (upright 
fearful minus neutral) that last longer than 20 msec. (A) Time- 
bins (in hot colours) during which MTLE-amygdala patients signifi- 
cantly differed from MTLE-control patients and healthy volun- 
teers, in response to the different upright expressions. Amygdala 
related abnormalities in ERP responses can readily be seen in two 
time-windows: An early effect, arising at around ~ 1 00 msec and 
lasting till ~ 1 50 msec is mostly expressed in posterior electrodes; 
and a later effect (~500-600 msec) is expressed more widely in 



central-posterior electrodes. Note that the later effect was mostly 
pronounced at around 500 and 575 msec. (B) Time-bins during 
which all three groups showed similar expression effects (for 
upright fearful minus neutral faces), that were unaffected by amyg- 
dala damage. Around ~ 1 80 msec post stimulus onset, at frontal 
central electrodes, a main effect of expression (upright fear > 
neutral) was observed, with a similar pattern across all three 
groups. Y-axis, individual electrodes (top-to-bottom): F, frontal: 
FPZ, F8, F4, FZ, F3, F7, FC6, FC5; T, Temporal: T8, T7; C, central: 
CP6, C4, CZ, C3, CP5; P, Parietal: P8, P4, PZ, P3, P7; O, occipital: 
OR, OZ, OL. [Color figure can be viewed in the online issue, 
which is available at www. interscience.wiley.com.] 



When considering each group separately for the 150-200 
ms interval, the maximal effect was at electrode Cz in the 
healthy (Z = 2.77, P = 0.003), at T7 in MTLE-control 
patients (Z = 2.26, P = 0.012), and at F8 in MTLE-amyg- 
dala patients (Z = 2.16, P = 0.015), although similar effects 
were seen at the neighboring electrodes and overlapped 
between groups. Likewise, for the 200-250 ms interval, 
fearful minus neutral effects peaked at electrode F8 for 
healthy (Z = 3.66, P < 0.001), FC6 for MTLE-control in vi- 
cinity (Z = 2.2, P = 0.012), and F7 for MTLE-amygdala in 
vicinity (Z = 2.05, P = 0.02). 

Unlike the earlier time window of 100-150 ms, the level 
of amygdala structural abnormality did not correlate with 
the fear effects for these two intervals, neither at 150-200 
nor at 200-250 ms (all P > 0.1). The preserved fear effects 
during these time windows in both patient groups were 
further confirmed by testing successive 5 ms time win- 
dows for each electrode separately (Fig. 3B). 

Emotion effects: Fearful versus neutral faces for 
later ERP components 

At 250-300 ms, a three-way interaction of group-by- 
expression-by-orientation was observed, now in vicinity to 
electrode T7 (Z = 1.94, P = 0.025; see Supporting Informa- 
tion Fig. S3A). However, this interaction reflected epileptic 
condition rather than amygdala pathology in particular. 
For this time window, the two MTLE groups differed 
from the healthy group in their brain responses to facial 
expressions and orientations. As this was not clearly 



related to amygdala function in particular and so falls 
beyond the focus of the current research, we did not pur- 
sue further our analysis for this time window. We note 
also that the finer time-bin analysis (Fig. 3A) suggested 
only weak and marginal amygdala effects around 280 ms 
poststimulus onset, involving Or and P4 electrodes only. 
As these effects were marginal and did not produce a criti- 
cal three-way-interaction nor a group-by-expression inter- 
action when tested for upright faces only (all Ps > 0.1), we 
did not consider them further. 

The next significant ERP effects were observed at 300- 
400 ms (Supporting Information Fig. S3B). Here all three 
groups showed a significant expression-by-orientation 
interaction, with a conjoint maxima peak in vicinity to F7 
(Z = 2.68, P = 0.004, minT 6 = 1.6). Further analysis 
revealed a significant conjoint effect of expression for 
upright faces, peaking in vicinity to F8 (Z = 1.92, P = 
0.027) and F7 (Z = 1.67, P = 0.048), but no conjoint effect of 
expression with inverted faces (P > 0.05). All groups 
showed increased positivity for fearful compared to neutral 
expressions in upright faces, maximal in vicinity to F7 in 
healthy (Z = 2.51, P = 0.006), to P4 in MTLE-control (Z = 
1.36, P = 0.087), and to F8 in MTLE-amygdala (Z = 1.42, P 
= 0.078) groups. We note that this effect was most reliable 
in the healthy participants, indicating that for this time win- 
dow, epileptic condition rather than specific amygdala pa- 
thology might exert some (marginal) influence. 

Finally, three-way interactions (group-by-expression-by- 
orientation) were also observed for the 500-600 ms time 
window, in vicinity to P8 (Z = 1.61, P = 0.05, see 
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Figu 

Expression effects at 150-250 ms that were not affected by 
amygdala damage. (A) 2D topographic maps of scalp distribution 
depicting ERP responses at 185 ms poststimulus onset. The left- 
most column represents responses to upright neutral faces and 
the next column shows responses to upright fearful faces. 
Warmer colors represent positive ERPs. Note that all three 
groups, healthy (upper row), MTLE-control patients (middle 
row), and MTLE-amygdala patients (bottom row), showed an 
increased positivity for fearful faces compared with neutral faces 
at this time. (B) 2D interpolated maps shown separately for 
each group, for the subtraction of upright fearful minus neutral 
faces, averaged across the time window 150-200 ms poststimu- 



re 4. 

lus onset. Warmer colors represent more positive ERP 
responses for fearful than neutral expressions. (C) SPMs thresh- 
old at P < 0.05, presenting the conjunction of expression effects 
(upright fear > neutral) found in common across all three 
groups, for the two successive time windows of 150-200 and 
200-250 ms poststimulus onset. There were no interactions of 
expression with group in these time windows and thus no 
impact of amygdala damage or of temporal-lobe epilepsy. (D) 
Averaged ERP waveforms for upright fearful (red) or neutral 
(dotted black) faces at electrode Fz, plotted separately for each 
group. The ellipses highlight the 150-250 ERP expression effects, 
as shown by each group in common. 



Supporting Information Fig. S3 A). Separate analysis 
revealed, for upright faces only, a significant group-by- 
expression interaction in vicinity to P8 (Z = 2.54, P = 
0.006). The MTLE-amygdala differed from the healthy at 
central posterior electrodes with a maxima at P8 (Z = 2.71, 
P = 0.003) and from the MTLE-control with a maxima also 
at P8 (Z = 3.11, P = 0.001 see Fig. 5). The two groups with 
intact-amygdala did not differ significantly (P > 0.1). Dur- 
ing this late time interval, healthy and MTLE-control 
patients, but not MTLE-amygdala (P > 0.1), showed an 
increased positivity for fearful versus neutral upright 



expressions at several posterior central electrodes (healthy 
peaking in vicinity to Ol, Z = 2.8, P = 0.003; MTLE-con- 
trols peaking in vicinity to P4, Z = 2.48, P = 0.007). This 
outcome was further confirmed by our finer-grained tem- 
poral analysis using successive 5 ms time windows for 
each electrode separately (Fig. 3A), which confirmed a 
clear amygdala-dependent difference around 500-600 ms. 

Moreover, the extent of separately measured, structural 
amygdala pathology (measured as the T2 MR signal) again 
correlated negatively with the size of the fear effect for the 
500-600 ms window, with more severe amygdala damage 
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Amygdala abnormality effects at 500-600 ms. (A) SPMs thresh- 
olded at P < 0.05, for the significant interaction of expression 
(upright fearful minus neutral) by group in the 500-600 ms time 
window. (B) Averaged ERP waveforms for upright fearful (red) 
or neutral (dotted black) faces at electrode P4, plotted sepa- 
rately for each group. The ellipses highlight the late ERP expres- 
sion effect that differs between groups. Note that similar to the 
results in Figure 3A, larger differences arose at around 500 ms 
and again at around 575 ms at peristimulus time. (C) Correla- 
tion of the severity of amygdala structural-abnormality and the 
size of the ERP expression effects (upright fear minus neutral) in 
the 500-600 ms time window. The left panel shows an SPM 
depicting pixels in the interpolated scalp image that show a con- 



joint significant correlation (P < 0.05) of the left and right struc- 
tural T2 signal from amygdala with the late expression effect. 
The plots on the right shows the T2 signal of right or left amyg- 
dala plotted against the expression effect extracted from the 
peak (in vicinity to P8). Red circles depict the MTLE-amygdala 
patients and black circles the MTLE-control patients. Note that 
the correlation of the right amygdala seemed to be driven 
mainly by the single patient who had a radiologically evident 
lesion to this structure. MTLE-amyg = patient group with amyg- 
dala damage; MTLE-cnt = control group of temporal-lobe-epi- 
lepsy patients, with structurally intact amygdala. [Color figure 
can be viewed in the online issue, which is available at 
www.interscience.wiley.com.] 



leading to more pronounced attenuation of fear-related 
positivity. The conjoint effect of left and right amygdala 
damage peaked in vicinity to P8 (Z = 2.47, P = 0.007, 
minT 16 = 1.46). The right amygdala parametric modula- 
tion of the upright fear > neutral responses during this 
time window peaked in vicinity to P4 (Z = 2.62, P = 
0.004), while the parametric modulation due to left amyg- 
dala pathology peaked in vicinity to P8 (Z = 1.75, P = 
0.04). In this late time window, frontal electrodes also 
showed some effect of right (but not left) amygdala pa- 
thology, with peak differences in vicinity to electrode F7 
(Z = 2.45, P = 0.007). This differential effect of right amyg- 



dala pathology is intriguing given the subclinical pathol- 
ogy of MR signal for the right amygdala in all MTLE 
participants but one. However, similar to the effects for 
the earlier PI effect (Fig. 2E), the present correlation with 
the right amygdala seemed to be substantially driven by 
this single patient with a radiologically evident right 
amygdala lesion (Fig. 5C), as removing this patient from 
the analysis reduced the extent of the correlation (r = 
-0.34, Z = 1.18, P = 0.12) for the late 500-600 ms time 
window. 

In this late time window, an interaction between expres- 
sion and orientation was also found to produce a bilateral 
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conjoint effects across all groups, peaking in vicinity to F7 
(Z = 2.16, P = 0.015; see Supporting Information Fig. S3B). 
Intriguingly, this conjoined frontal effect originated from 
an expression effect observed for inverted faces in particu- 
lar. Here, all three groups showed increased negativity for 
inverted fearful compared to inverted neutral faces (Z = 
1.77, P < 0.038), but not for upright faces (P > 0.1). This 
expression effect may reflect different visual processing 
demands for inverted faces, but for present purposes the 
main point is that this was not affected by amygdala 
pathology. 



DISCUSSION 

In this study, we measured EEG responses to threat 
stimuli in three groups (healthy controls, temporal lobe 
epilepsy patients with intact amygdale and with damaged 
amygdala). We show that the human amygdala has a sig- 
nificant role in modulating brain responses to threat- 
related facial expressions at specific, early and late, time 
points. Critically, we show that the impact of amygdala 
damage expresses itself at two specific time windows post- 
stimulus onset: 100-150 and 500-600 ms. In addition, we 
observe differential responses to fearful versus neutral 
expressions in upright faces during an intervening time 
window (150-250 ms) that remain intact despite amygdala 
damage. We propose that these latter findings may relate 
to the fact that explicit perception of fearful expressions 
was preserved in our MTLE-amygdala participants, as 
shown by their behavioral responses. By contrast, both 
early and late ERP responses to fearful faces were selec- 
tively disrupted by amygdala damage, but preserved in 
MTLE patients with intact amygdala, as well as for healthy 
controls. Taken together, the results indicate multiple proc- 
essing stages or routes for fearful face stimuli, which vary 
in their timing and their dependence on normal amygdala 
function. Our data reveal for the first time that amygdala 
pathology disrupts an early and a late cortical processing 
stage for fearful faces while sparing an intermediate stage 
of emotion-related processing. 

The earliest ERP effect specific to upright fearful versus 
neutral faces here was observed in healthy and MTLE-con- 
trol groups within ~100-150 ms, emerging as a "fear" 
enhanced positivity at ~120 ms after stimulus onset, over 
posterior electrodes. By contrast, within this same time 
window, an abnormal ERP response in the MTLE-amyg- 
dala group was observed, corresponding to a loss of this 
early fear-induced positivity (Figs. 2 and 3A). Moreover, 
the attenuation of this effect was larger in patients with 
more severe amygdala structural pathology, suggesting a 
direct causal role for the amygdala. This early ERP expres- 
sion effect corresponds with the well-established latency 
and spatial distribution of the PI component, which is 
thought to arise from extrastriate visual cortex [Di Russo 
et al., 2002, 2003]. Therefore, these results provide new evi- 
dence that processing of fearful faces in visual cortex is 



susceptible to a rapid modulation by the amygdala. This 
supports previous suggestions that the amygdala provides 
rapid and "reflexive" feedback to cortical processing, to 
promote an effective response to potential threat [Amaral, 
2002; Dolan, 2002; LeDoux, 1996; Phelps and LeDoux, 
2005; Vuilleumier, 2005]. 

A second abnormal ERP fearful response in the MTLE- 
amygdala group was expressed in a much later time win- 
dow, 500-600 ms poststimulus onset (i.e., corresponding 
with the late-P3, Figs. 3A and 5). Emotion-related ERP 
effects in this time-range have been associated with possi- 
ble arousal responses [Kissler et al., 2006], while others 
have linked them to enhanced episodic memory-related 
processing for emotional stimuli [Maratos et al., 2000]. 
This latter interpretation might appear potentially at odds 
with the behavioral results reported here, e.g., no effect of 
amygdala pathology on the one-back task. However, we 
note that the late-P3 ERP emotional memory effect has 
previously been discussed in the context of long-term epi- 
sodic memory processing [Maratos et al., 2000] rather than 
in the context of short-term working memory as required 
by the one-back task used here. In support of the proposal 
that the amygdala may be involved with episodic emo- 
tional memory processing, it has been shown that the se- 
verity of structural amygdala abnormality in MTLE 
patients predicts mnemonic impairments related to emo- 
tional stimuli [Richardson et al., 2004], i.e., a loss of the 
usual long-term memory advantage for emotional relative 
to neutral stimuli. A wide literature suggests a crucial 
involvement of amygdala in emotional memory processes 
[Dolan, 2002; LaBar et al., 1995]. Our new ERP results in 
the 500-600 ms ("late P3") time window may relate to this. 

Taken together, our early (PI) and late (P3) amygdala- 
damage effects on expression-related ERPs indicates that 
the amygdala directly affects both perceptual-attentional 
and mnemonic processing. PI modulations have often 
been reported to relate to attention-related enhancements 
of processing in visual cortex [Di Russo et al., 2003; 
Holmes et al., 2003], and such visual effects might account 
not only for better detection of emotional stimuli in atten- 
tion tasks [e.g., Phelps and LeDoux, 2005; Vuilleumier, 
2005] but also potentially contribute to strengthening sub- 
sequent memory traces for emotional material [Adolphs 
et al., 2005; Buchanan et al., 2006; Talmi et al, 2007]. Our 
findings that amygdala damage also affected a later dis- 
tinct ERP component (late P3), associated with memory, 
provides a novel line of evidence for amygdala influences 
on learning and memory formation, on top of any earlier 
attentional effect. 

In contrast to the abnormal early and late ERP 
responses, the MTLE-amygdala patients demonstrated nor- 
mal explicit perception of fearful expressions. This was 
observed for prototypical Ekman expressions [Ekman and 
Friesen, 1976], and also when using a more sensitive mea- 
sure with the morphed-hexagon expressions [Calder et al., 
1996]. These findings suggest that normal functioning of 
the amygdala is not a prerequisite for explicit fear 
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recognition, consistent with some other reports [Adolphs 
et al., 1995; Graham et al., 2006; Rapcsak et al., 2000]. Fur- 
thermore, amygdala pathology did not affect performance 
in the one-back task performed during EEG recording that 
is presumably based on short-term or working memory. 
All three groups showed more accurate responses to fear- 
ful compared with neutral expressions in the one-back 
task, and this was unaffected by amygdala damage. 

Likewise, we also observed preservation of fearful 
expression effects on ERPs, specifically during the 150-250 
ms (and to a lesser degree the 300-400 ms) time windows 
that intervened between the early and late abnormalities. 
A fear effect during this time window was observed for 
the MTLE-amygdala participants, just as for the healthy 
group and the MTLE-controls (Figs. 3B and 4). An 
enhanced positivity in response to fearful as compared to 
neutral faces has been found between 130 and 200 ms after 
stimulus onset in several previous ERP studies (see Eimer 
and Holmes [2007], for a review). This effect is assumed to 
be linked to the explicit detection of fearful faces and typi- 
cally shows a fronto-central scalp distribution, similar to 
what was observed in the present experiment during the 
150-250 ms time interval for all three groups. 

In keeping with the explicit behavioral judgments and 
performance of the one-back task, these aspects of the ERP 
data indicate that not all fear-related processes were dis- 
rupted in MTLE-amygdala patients. We surmise that the 
preserved ERP and behavioral effects might be linked, 
pointing to a processing stage at around 150-250 ms post- 
stimulus onset mediating both explicit fear perception and 
emotional effects on working memory. This hypothesis 
accords with previous ERP data in healthy participants 
that tentatively linked fearful ERP effects at this time win- 
dow to explicit processing of expression [Mikhailova and 
Davydov, 1999], and showed that these ERP responses to 
expressions depend on attention to the stimulus [Eimer 
and Holmes, 2007]. In any case, the preserved fear effect 
for this time-period in MTLE-amygdala subjects certainly 
demonstrates that not all processing of fearful faces 
depends on contributions from the amygdala, suggesting 
instead that there are multiple pathways for processing 
emotional information [Amaral, 2002; LeDoux, 1996; Vuil- 
leumier, 2005], each involving differential neural structures 
and importantly operating with a specific time course. 

Although our ERP data revealed that amygdala pathol- 
ogy affected fear processing in two distinct time windows, 
no deficits were evident in the particular behavioral meas- 
ures used in this study (explicit recognition of expressions, 
or performances in a one-back memory task). This raises 
the question of what is the possible functional significance 
of these ERP effects. We speculate that the early ERP 
expression effect (around the PI) might constitute a 
marker for a signal that acts to direct processing resources 
toward potential threat in the environment, in accord with 
previous imaging data on PI responses to emotional stim- 
uli [e.g., Pourtois et al., 2004, 2005b]. This neural marker 
could possibly also prepare the autonomic response sys- 



tem to react to potential threat in the environment [Critch- 
ley et al., 2005; Williams et al., 2004]. We further suggest 
that this signal might facilitate the explicit perception of 
expression but is not necessary for it. Therefore, we pre- 
dict that amygdala damaged patients should show 
impaired autonomic responses to threat stimuli and 
reduced attention-capture by threat-related stimuli (see 
Anderson and Phelps [2001]). The late ERP effect (500-600 
ms) may relate to the facilitation of emotional influences 
on encoding into long-term memory. Thus, the same 
amygdala patients should show a loss of the usual 
enhancement in long-term memory for emotional items 
(see Adolphs et al. [2000] and Richardson et al. [2004]). 
Further research is needed to establish the exact behavioral 
significance of the different effects of amygdala damage 
on ERPs to various classes of emotional stimuli, in differ- 
ent perceptual and memory task conditions. But for pres- 
ent purposes, the present ERP results clearly establishes 
an impact of amygdala damage on the brain response to 
fearful versus neutral faces at distinct time windows, 
while showing other brain responses remain intact at 
intervening time windows. 

Finally, in accordance with previous literature [Rotshtein 
et al., 2001], our data suggest that during the first 600 ms 
poststimulus onset, the amygdala was involved only in 
processing fearful expressions for upright but not inverted 
faces. Effects of fearful expression with inverted faces 
were observed at 500-600 ms, but crucially those were not 
affected by amygdala pathology. This particular late effect 
may correspond to a delay in expression recognition that 
has been reported as typical for inverted faces [McKelvie, 
1995]. Further research is needed to gain a better under- 
standing of the fear effect in inverted faces. In addition, it 
is interesting to note that medial temporal lobe pathology, 
irrespective of amygdala involvement or sparing, pro- 
duced some distinct effects on expression processing at 
250-300 ms. This dissociation between general MTLE 
effects, versus amygdala-specific effects, emphasizes the 
necessity of including a control group that shares etiology 
and medical history with the neurological group of main 
interest (MTLE-control vs. MTLE-amygdala, respectively), 
as done here, to better isolate the specific relationship 
between brain structures and function. 

In conclusion, our ERP data show for the first time that 
the amygdala makes distinctive contributions to process- 
ing of fearful faces in at least two distinct time windows, 
both early (100-150 ms) and late (500-600 ms). We demon- 
strate a reduction of these effects due to amygdala dam- 
age, in direct parametric proportion with the structural 
severity of the pathology. Conversely, we show that at an 
intervening time window (150-250 ms), the effects of fear- 
ful expression on brain responses were preserved despite 
amygdala pathology. We conclude that threat-related stim- 
uli are processed within multiple neural stages and path- 
ways, some dependent on the amygdala and others not, 
each with a particular time-course. More generally, our 
study illustrates how combining the lesion approach with 
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EEG recording can uncover the specific time-points at 
which the damaged area normally contributes to influence 
information processing in distant cortical regions that sur- 
vive the lesion. 
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